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On uniqueness theorems for Tsallis entropy and 

Tsallis relative entropy 
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Abstract — The uniqueness theorem for Tsallis entropy was 
presented in H.Suyari, IEEE Trans. Inform. Theory, Vol.50, pp. 1783- 
1787 (2004) by introducing the generalized Shannon-Khinchin's 
axiom. In the present paper, this result is generalized and 
simplified as follows: Generalization: The uniqueness theorem for 
Tsallis relative entropy is shown by means of the generalized 
Hobson's axiom. Simplification: The uniqueness theorem for 
Tsallis entropy is shown by means of the generalized Faddeev's 
axiom. 

Index Terms — generalized Faddeev's axiom, generalized Hob- 
son's axiom, generalized Shannon-Khinchin's axiom, Tsallis en- 
tropy, Tsallis relative entropy, uniqueness theorem. 



I. Introduction 

Shannon entropy is uniquely determined by the Shannon- 
Khinchin's axiom [1], which is referred to as the uniqueness 
theorem for Shannon entropy. The Shannon-Khinchin's axiom 
was improved by A. D. Faddeev [2] in the sense that the 
conditions of his axiom are simpler than those of the Shannon- 
Kinchin's axiom. (For details, see [3], [4], [5], [6].) As a 
generalization of the axiomatic characterization of relative 
entropy, the uniqueness theorem for relative entropy was 
proven by A. Hobson [7]. Moreover, recently, the nonextensive 
entropies, including Tsallis entropy, were characterized by H. 
Suyari in terms of the generalized Shannon-Khinchin's axiom 
[8]. The uniqueness theorem obtained by a generalization of 
the Shannon-Khinchin's axiom for the structural a-entropy, 
which is one of the nonextensive entropies, was the first 
appearance of such generalized results [9]. 

The present paper proves the uniqueness theorem for Tsallis 
relative entropy by combining the axioms of Hobson and Su- 
yari. This uniqueness theorem is a simultaneous generalization 
of their results with respect to the following two points. The 
Hobson's theorem is generalized as a parametric extension, 
and the Suyari's theorem is generalized in the sense that the 
relative entropy function is an extension of the entropy func- 
tion. In addition, the uniqueness theorem for Tsallis entropy 
is proven by the simplification of the generalized Shannon- 
Khinchin's axiom in the sense that the Faddeev's axiom is 
simpler than Shannon-Khinchin's axiom. 

This paper is organized as follows. In Section [H] a brief 
review of Tsallis entropy and Tsallis relative entropy is pre- 
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sented. In Section |in| the generalized Shannon-Khinchin's 
axiom introduced by H. Suyari and the uniqueness theorem 
for Tsallis entropy are reviewed. In Section lTvl the uniqueness 
theorem for Tsallis relative entropy by means of the general- 
ized Hobson's axiom is shown, and the function 4>(q), which 
will be described in Theorem lIV.3l is characterized. In Section 
|VJ the uniqueness theorem for Tsallis entropy is shown by 
means of the generalized Faddeev's axiom. Finally, a theorem 
on the relation among the generalized Shannon-Khinchin's 
axiom, the generalized Faddeev's axiom, and Tsallis entropy 
is presented. 

II. Tsallis entropy and Tsallis relative entropy 

A. Tsallis entropy 

Several extensions of entropy have been formulated and 
investigated [10], [11], [12], [13], [14], [15]. Prevalent among 
these extensions is the Renyi entropy [10], [11], [13]: 

R q P0 = 



■ / J i 

8=1 



(9/1), 



(1) 



which has the additivity property 



Rg(X xY) = R q (X) + R q {Y), 



(2) 



for two independent random variables X and Y, Tsallis 
entropy introduced in [14], the definition of which is presented 
herein, the structural a-entropy [9], and the entropy of type f3 
introduced in [12] are referred to as nonadditive (nonextensive) 
entropies because these entropies do not have an additivity 
for two independent random variables, whereas the Renyi 
entropy introduced in [10] and Shannon entropy are referred 
to as additive (extensive) entropies, due to Eq.Q. The present 
study examines the nonextensive entropies, including Tsallis 
entropy as a typical example. Tsallis entropy was defined by 
C. Tsallis in the field of the statistical physics for the purpose 
of analyzing multifractal systems [14]. 

Definition II.l (Tsallis [14]) For any nonnegative real num- 
ber q and the probability distribution p L = p(X — — 
1, • • ■ ,n) of a given random variable X, Tsallis entropy is 
defined as follows: 



S q (X) = - ^2pfln q pi 



(3) 



with parameter q as an extension of Shannon entropy, where 
the g-logarithm is defined as ln g (x) = x l _ q 1 for any non- 
negative real numbers q and x, and the convention 01n„(-) = 
is set. 
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The Tsallis entropy S q (X) converges to Shannon entropy 
— Y^i=i Pi log? 5 * as g — > 1, because the g-logarithm uniformly 
converges to a natural logarithm as q — ► 1. Tsallis entropy 
plays an essential role in nonextensive statistics, which is 
often called Tsallis statistics, so that several important findings 
have been published [15]. In addition, since the q-logarithm 
function hx q (x) has the pseudoadditivity property for q ^ 1: 

\n q (xy) = \n q (x) +\n q (y) + (1 - q)\n q (x)ln q (y), (4) 

Tsallis entropy has the pseudoadditivity property for q ^ 1: 

S q (X xY) = S q (X) + S q (Y) + (1 - q)S q {X)S q (Y). (5) 



Remark II.2 Although a simple transformation exists be- 
tween the Tsallis entropy and the Renyi entropy, such that 



R q (X) = 



1 



1-9 



log {l + (l-g) £,(*)}, 



(6) 



their structures differ with respect to their additivities (cf. 
Eq.(|2|i and Eq.©)- 



B. Tsallis relative entropy 

A relative entropy based on Tsallis entropy which is a 
typical nonextensive entropy, was formulated and discussed in 
[16], [17], [18] from a physical point of view. The fundamental 
properties of Tsallis relative entropy in both classical and 
quantum systems were investigated in [19] from a mathemat- 
ical point of view. 

Definition II.3 Here, probability distributions ctj and bj are 

assumed to satisfy dj > 0, bj > and Yjj=i a i ~ T^j=i = 
1. Tsallis relative entropy between A = {ctj} and B = {bj}, 
for any q > 0, is then defined as 



D q {A\B) 



aj In, 

3=1 



(7) 



Note that lim^i D q (A\B) = D X (A\B) = ££ =1 <h log g-, 
which is known as relative entropy (often referred to as 
Kullback-Leibler information, divergence or cross entropy). 
For Tsallis relative entropy, several fundamental properties, 
which are listed below, hold as parametric extensions of 
relative entropy (for example, [19]). 

Proposition II.4 (1) (Continuity) D q (A\B) is a continuous 
function for aj and bj. 

(2) (Nonnegativity) D q (A\B) > 0. 

(3) (Symmetry) 

D q (a T (i), • • • , a 7r („) \b n (\), • • • , b^ n ) ) 
= D q (ai, ■■■ ,a n \bi, •••,&„). 

(4) (Possibility of extension) 

D,(ai, ■••,o n ,0|6i 1 --" 1 6 7 i,0) 

= D q (ax, ■■■ ,a n \h, ■••,&„). 



D q UW x A^ 

= D q 



(5) (Pseudoadditivity) 

B W x B (2) 

B^A+Dq (A^ 2 
+ (q-l)D q (AW|BW)u g (a< 



2 



B 



(2) 



where 



and 



A« x A^ = {af ] af \af e A®,i = 1,2} 
BW x b< 2 ) = [bfhf \bf e sW,»= 1,2} . 



(6) (Joint convexity) For < A < 1, any q > and the 
probability distributions A® = {a^kfiW = [bf\, 
(i = 1, 2), we have 

D q (AA« + (1 - A) A( 2 )|ASW + (1 - A) fl< 2 >) 

< A# 9 (a«|B?«) + (1 - A) D q (a&\B( 2 A . 

(7) (Additivity) 

Dq (ax,--- 

bi, ■ ■ ■ , h-i, bi 1 , bi 2 , bi + i, ■ ■ ■ ,b n ) 
= D q (ai, ■■■ ,a n \bi, ■ ■ ■ ,b n ) 

+a\b\~"D q 



(— 


a,i 2 


K_ bi2_\ 









where a, = a il + a l2 > b i = b il + b l2 . 
(8) (Monotonicity) For a transition probability matrix W, we 
have 

D q (WA\WB) < D q (A\B) . 

Conversely, in the present paper, Tsallis relative entropy is ax- 
iomatically characterized by the generalized Hobson's axiom. 

III. Review of the generalized 
Shannon-Khinchin's axioms and the uniqueness 
theorem for tsallis entropy 

The generalized Shannon-Khinchin's axiom introduced 
by H. Suyari is reviewed in the following. The function 
S q (xi, ■ ■ ■ ,x n ) is assumed to be defined for the rt-tuple 
(«!,-• ■ ,x n ) belonging to 



(P 



l,"',Pr, 



= 1, Pi > (i = !,••-, n) 



and to take a value in R + = [0, 00). 

Axiom III.l (Generalized Shannon-Khinchin's axiom) 

(Gl) Continuity: The function 

R+ 



S q : A r , 



is continuous. 
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(G2) Maximally: 



(H3) Grouping axiom: 



S„ ( — , ••■,— ) = max.{S q (xi, ■ ■ ■ ,x n ) ■ Xi e A„} > 0. 
\n n J 

(G3) Generalized Shannon additivity: For Xij > 0, Xi — 

(^-11 ; ' ' ' •> %7im n ) — Sq{x\ , * ' ' , X n ) 



|6l,l, • ' ' i &l,mi 62,1, • ' ' , 62,7 

= Di (ci,c 2 |di,d 2 ) 



n ✓ 



+ciD x 
+c 2 D 1 



ai,i 

Cl 
Q2,l 
C2 



ai,r. 



Cl 

Q2,m 
C2 



6m 

di : 

&2,1 
d 2 ' 



di 

62,771 



(G4) Expandability: 

Sq(xi, ■ ■ ■ , £„, 0) = S q (xi, • ■ ■ , I„). 

Note that condition (G4) is altered slightly from [GSK4] of 
the original axiom [8]. In condition (G2), the strict positivity 
of the maximum value of Tsallis entropy S q (xi, ■ ■ ■ , x n ) is 
also imposed, in addition to [GSK2] of the original axiom [8]. 
This adoption excludes a trivial situation that Tsallis entropy 
is constant zero. Then, the following theorem was shown by 
H. Suyari [8]. 



where a = YJjL\ a i,j and d* = YJjLi Kj- 

(H4) Dx{A\B) = if a, = bj for all j. 

(H5) £>i(i,---,i,0, •••,0|^,---,^) is an increasing func- 
tion of n and a decreasing function of n, for any integers 
n and n such that n a > n. 

The function D q is defined for the probability distributions 
A = {a,j} and B = {bj} on a finite probability space with 
one parameter q > 0. Tsallis relative entropy is characterized 
by means of the following triplet of the generalized conditions 
(Rl), (R2) and (R3). 



Theorem III.2 (Suyari [8]) Conditions (Gl) to (G4) deter- 



mine the function S q such that 



(8) 



where <f>(q) is characterized by the following conditions: 

(i) <j>{q) is continuous and <f>(q)(q — 1) > for q ^ 1. 

(ii) lim g ^i <j)(q) = and 4>(q) ^ for q ^ 1. 

(iii) There exists (a, b) C R + such that a < 1 < b and <fi(q) 
is differentiable on (a, 1) and (1,6). 

(iv) There exists a positive constant number k such that 
Km * Mi) - I 

IV. Axiomatic characterization of Tsallis 

RELATIVE ENTROPY BY THE GENERALIZED HOBSON'S 
AXIOM 

A. Uniqueness theorem for Tsallis relative entropy 

The uniqueness theorem for relative entropy was shown by 
A. Hobson as follows [7]: 

Theorem IV.l (Hobson [7]) The function D].{A\B) is as- 
sumed to be defined for any two probability distributions 

A = {aj} and B = {bj} for j = l,---,n. If D X {A\B) 
satisfies the following conditions, then it is given by the form 
k Y^j=i a j 1°S TT w ^ tn a P os iti ve constant k. 

(HI) Continuity: D\(A\B) is a continuous function of 2n 
variables. 

(H2) Symmetry: 



Axiom IV.2 (Generalized Hobson's axiom) 

(Rl) Continuity: D q {a\, ■ ■ ■ , a„|£>i, • • • , 6 n ) is a continuous 

function of 2n variables. 
(R2) Symmetry: 

Dq (oi, ■ • • ,Oj, • • • , at, • • • , a„|6i, • • • , 6j, • • • , 6fe, ■ • • ,6 n ) 
= -Dg (ai, ■ • • ,afe, • • • , aj, ■ ■ ■ , a„|6i, • • • , 6fc, • • • , bj, ■ ■ ■ , b n ) . 



(R3) Generalized additivity: 

Dq ((Xl,l, , Gi.m, , CLn,l, , Q*n,m 

614, • • • , bi ym , ■ ■ ■ , 6 ni i, • • • , 6„ iTO ) 
= D q (d, ■ ■ ■ ,c n \di ■■■ ,d n ) 



Z?i (01, • • • ,a,j, ■ ■ ■ ,Ofc, • • • , a„|6i, ■ • • ,bj, ■ 



■,b n ) 



= Di (ai, • • • , a/s, • • • , aj, ■ ■ ■ , a n \bi, ■ ■ ■ , bk, ■ ■ ■ , bj, ■ ■ ■ , b n ) . 



(9) 



where Ci = YijLi a hj and d 4 = YSjLi Kj- 
Then, we have the following theorem: 



Theorem IV.3 If conditions (Rl), (R2) and (R3) hold, then 
D q (A\B) is given in the following form: 



D q (A\B) 



n „q h l-q 



i-E?=io?fe 



(10) 



with a certain function <p(q). 



Proof: We prove the theorem by using conditions (Rl), (R2) 
and (R3). First, we define 

f q {s,t) = D q (- s ,-.-,- s , 0,---,0||, (11) 
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for any natural numbers s and t such that t > s. From condition (R3), we have 
condition (R2), we have 



1 



1 



D g .•).•••.!). 



1 



tv tv 



1 



1 



Da — ... — , 



o,-..,o, 

Also, from condition (R3), we have 
D, 



0, • - - , 0|— , - - • , — 

tv tv 



,0,...,0,- 

Sti Sit 



, 1 1 

tv tv 

d„ i o,..-,o 



i 



-" [ - 



u u 

l - q (\ 1 

D q 0,---,0 



From the above two equations, we have 



1 



1 



1 



1 



9 1 i ' ' 
1 SU SU 



D n 



0, .().•••.<) 

tv 

11 ,11 

_o,--.,o 

u u v v 



1 

tv 



u) \v 
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1 



1 



D q -, 0, - • - , 0|-, 



D 



1 



1 



.o,---,o, 



v E ^ E ^ 

\fe=i k=i 



E 

fe=i 



i 



E h 

k=l 



o,---,o 



1 



E m k 



k=l 



' ' n 

E m k I 



-^g (c?o ; C n |di, i dn ) 
- / 1 1 

Y,4d\- q D q 0,... 



i—1 x 

Thus, we have 

-Dq ( C j , * ' * , C n | G?i , • • • , c£ n J 

(n n \ 

fe=l fe=l / 

1-9 



i - ( E «* 



n 

E m fc 

k=l 



9-1 



0(9) 



i - E c?d. 



,9j1-9 



0(9) 

From condition (Rl) and the fact that any real number can 
be approximated by a rational number, the above result holds 
for any positive real numbers a; and bi satisfying E"=i a i = 

r; .>>. i- 



Thus, we have 

/U\ 1—9 

f q (su, tv) = fg (u, v) + [-) f q (s,t). 

Using a method similar to that used for Lemma 5 in [9], we 
find that there exists a certain function 4>(q), which depends 
on the parameter q only, such that 



We give a remark on the conditions of Axiom IIV.2I in the 
following proposition. 

Proposition IV.4 The following conditions (R3') and (R4), 
and the symmetry (R2) imply the condition (R3). 

(R3') Generalized grouping axiom: 



/,(*,*) 



1 



,1-9 



<(<?) 



D q (ai,i, • ■ • 

\bl,l, " ' ' j &l,m, ^2,1, - ' ' , &2,m 



Here, all a, t and b i7 (i = l,---,n) are assumed to 
be rational numbers. Then, setting c, = — , d, = 

£'* 

(j = l,-..,n.) for some natural numbers 



E mk 

k=l 

li and m,j such that £j < and we set 



„9 / 



+44- q D q 



d 2 ) 












) 

Cl 


Cl 


di 


«2,1 


fl2,m 


&2,1 


5 

C2 


C2 


d 2 



di 

&2.m 



E 1 * 



where e* = E"li <k,j and d, = Ej=i ^j- 
(R4) = if Oj = 6j for all j. 



E 



1, • • • , n; 7 = 1, ■ • • , mi) . Substituting into D s u tU t fT / i \ _ 

' ' ' ' iy 6 Proof: Here, the notation D q {a\, ■ ■ ■ , a n |*J = 

D q {a±, ■ ■ ■ , a n \bi, ■ ■ ■ , 6 n ) is introduced in order to simplify 
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the proof. From condition (R3'), we have 

D q (oi, ■■■,a n |*) = D q {A,a n -i + a n \*) 

+ (a n -l + an) 9 (frn-l + &n) 

Q"n— 1 I 



x£>„ 



C„+l 



v C n T" Cn+l C n -\- C n +1 

+c q d 1 " q D ( — ••• — 



i+l u n+l- L/ 



a n _i + a„ a n _i + a„ 



(12) 



and 



D q (ax, ■ ■ ■ ,fl n - 2 ,ffln-i + a™ I*) 
= D q (A,a n -i +a n \*) 

+ (a n _i + a„) 9 (6n_i + b n f- q D q (1 11) (13) 

where A = ai + ■ ■ ■ +a n _2 and £>=&! + •• - + 6 n _2. Thus the 
condition (R4) and the above equations Ea.(ll2> and Ea.( ll3> 
imply 

D q (ai, • • ■ ,a„ |k) 

= £> g (oi, ■ • ■ , a„- 2 , a n _i + a n |*) 

+ K-i + a n ) q (b n -i + &„) 1_<z 

^n- 1 



a„_i + a n a n —x + a n 



(14) 



Next, we derive condition (R3) by induction on n. Assuming 
that condition (R3) holds for some natural number n, we have 

D q (ai,i, • • • , a>i, m , ■ ■ ■ , a„ + i4, • • • , a n +i, m |* ) 



^n — 1 ? Cn + c„+i I*) 
&z,l &z,n 



n-1 



c,: Q 
+ (c„ + c, i+ i) 9 (d„ + rf„ + i) 1-9 

&n,l &n,m 



xD n 



«n+l,l 



Cn T" C-n-\-l 



by the use of (R2), (R4) and Ea.lTBl, By Ea.flll. the first 
term in the right-hand side of Eq.( I15> can be written as 

D q (ci, • • ■ ,Cn-i,Cn + c n+ i |*) 



D q (ci, ■■■ ,c n , c„+i |*) 

- [Cn + Cn+l 

Cn C n +1 



q (d n +d n+1 f- q 



xD„ 



(16) 



By condition (R3'), the last term in the right-hand side of 
Ea.( ll5t can be written as 



(c„ + c n+1 ) q (d n + dn+i) 1 9 

0"n,l 



xD„ 



a,-. 



Cn H - 

a n+l,l 



"n+l,m i 



Cn C n _|_i C n T" C n -\-i 

(c n + c„+i) 9 (d n + dn+i) 1 ^ 9 



Cn+l C n +1 

Substituting Eq.J16l> and Eq.l^} into Eq.J15l>. we have 

Dq (ffll.l, ■ • • , Ctl.mi * " " ) a n+l,l, ' ' ' i »n+l,m |* ) 

= -D g (ci, • • ■ ,c„,c n+ i |*) 



(17) 



n-1 



i=l 



9 1 ' ' 

Ci Ci 



+c q d 1 ~ q D -^i ••• — 

+ c n+l a ra+l- Ly 9 



Cn C n 
0>n+l,l a n+l,m 



Cn+l 



Cn+l 



which means that condition (R3) holds for n + 1. Thus, the 
proposition is proven. ■ 



From Proposition lIV.4l we find that we may adopt the axiom 
composed of the set of { (R1),(R2),(R3') and (R 4) } instead 
of the set of { (R1),(R2) and (R3) } in Theorem 

Condition (R3') of the present paper is a generalization of 
(H3) in the sense that the factor c q d q of the second term in 
the right-hand side of Eq.(|9} is a parametric extension of the 
factor cjdf of that of Eq.0, satisfying q + q' = 1. Condition 
(R3') of the present study contains the information on as 
a factor of each function D q in the second term in the right- 
hand side of Eq.(|9j, whereas the original condition (H3) does 
not, because it is eliminated by = 1 in such a special case. 

B. Characterization of <f>(q) 

In this subsection, the function <p(q) appeared in Theorem 
IIV.3I is characterized. 

Proposition IV.5 The property whereby Tsallis relative en- 
tropy is one parametric extension of relative entropy: 



lim DJA\B) = fcV U4 log ^ 

2 = 1 ■> 



(18) 



characterizes the function 4>(q) such as 
(cl) iim^i <f>{q) = 0. 

(c2) There exists an interval (a, b) such that a < 1 < b, and 

4>(q) is differentiable on the interval (a. 1) U (1, b). 
(c3) There exists a positive number k such that 

lim , Mil - _I 
nm^i dq — k - 



Proof: Eq.dl8l> implies 

linw (l - £2=i a q b\- q 



condition (cl), since 
0. If we differentiate 

1 — £!Lj a\b\~ q by q, then we obtain condition (c2). 
Moreover, by l'Hopital's formula, we have 

- £™ =1 a q b\~ q (log ai - log h) 



lim D q (A\B) = lim 

q-tl q-+l 



dq 



6 



which implies condition (c3). 



Proposition IV.6 The condition whereby D q (A\U) takes the 
minimum value for a fixed posterior probability distribution 
as a uniform distribution U = {-,-••,-) : 
(R5) Minimization : 

n ! I 1 1 1 1,1 1 

D q (ax, ■ ■■ ,a n \ — , 



~)>D q (-, 
n n 



implies 

(c4) <j){q)(l -q) >0for 1. 

Proof: Since 1 — X)"=i a f * s concave m Qi for q > 1 
and convex in at for < q < 1, we obtain condition (c4) in 
order to satisfy the condition that D q (A\U) takes a minimum 
value. 

■ 

As a simple example of (f>(q) satisfying the conditions (cl) 
to (c4), we take <f>(q) = 1 — q and k = 1, and then obtain 
the Tsallis relative entropy defined in Eq.@. Also, setting 
4>(q) = 1 — 2 1 ~ q and k = 1, we obtain the relative entropy of 
type (3 



D q {A\B) 



which appeared in Eq. (7.2.46) of [13]. See [20], [21] for 
different approaches to the axiomatic characterization for the 
relative entropy of type (3. 

V. Generalized Faddeev's axiom and uniqueness 

THEOREM FOR TSALLIS ENTROPY 

A. Simplification of the uniqueness theorem for Tsallis entropy 

The function S q (xi, ■ ■ ■ ,x n ) is assumed to be defined for 
the n-tuple (xi, ■ ■ ■ ,x n ) belonging to A„ and to take a value 
in R + . In order to characterize the function S q (x\, • • ■ , x n ), we 
introduce the following axiom, which is a slight generalization 
of the Faddeev's axiom. 

Axiom V.l (Generalized Faddeev's axiom) 

(Fl) Continuity: The function f q (x) = S q (x,l — x) with 
parameter q > is continuous on the closed interval 
[0, 1] and f q (xo) > for some xo 6 [0, 1]. 

(F2) Symmetry: For arbitrary permutation {x' k } G A„ of 
{x k } E A„, 

S q (x 1 ,- ■ ■ ,x n ) = S q (x' 1 ,---,x' n ). (19) 

(F3) Generalized additivity: For x n = y + z, y > and z > 0, 



S q {x\ , ' • ■ , X n —i, y 7 z) — Sq[Xx : ■ ■ • 7 X n ) 
■ x, n u q 



(20) 



Conditions (Fl) and (F2) are identical to the original Fad- 
deev's conditions, except for the addition of the parameter q. 
Condition (F3) is a generalization of the original Faddeev's 
additivity condition in the sense that condition (F3) of the 
present paper uses x n as the factor of the second term in 
the right-hand side, whereas the original condition uses x n as 



this factor. Note that condition (F3) of the present paper is 
a simplification of condition (G3) in [8], because condition 
(F3) of the present paper does not require the summation on 
i from 1 to n. Moreover, the present axiom does not require 
the maximality condition (G2) in [8]. Therefore, the present 
axiom improves the generalized Shannon-Khinchin's axiom 
introduced in [8] for the characterization of Tsallis entropy. For 
the above generalized Faddeev's axiom, we have the following 
uniqueness theorem for Tsallis entropy: 

Theorem V.2 Conditions (Fl), (F2) and (F3) uniquely give 
the form of the function S q : A„ — > R + such that 



S q {x u - ■ ■ ,x n ) = -Aq xl \n q 



(21) 



where X q is a positive constant that depends on the parameter 
q > 0. 

Proof: For the special case of q = 1, the present theorem 
directly follows from the theorem shown in [4]. Thus, q ^ 1 is 
assumed. The proof of this theorem is similar to that presented 
by H. Tveberg [4]. From conditions (F2) and (F3), for any 
x, y, z satisfying x, y > 0, z > and x + y + z = 1, S q (x, y, z) 
is expanded into separate equations: 



S q (x,y,z) = S q {x,y + z) + (y + z) q S q 

= S q {y,x + z) + (x + z) q S q 
Therefore, we have 

/,(*) + (i - x yf q 



V 



z 



y + z y + z 

x z 



X + Z X + z 



f q {y) + {i-v) q f q {y^) 



(22) 



Since Ea.J22> is defined for any < x < 1 and < y < 1, 
by setting x = and y > 0, we have 



fM + fM = fM + £-y) q fM- 

Thus, we have 

S g (0,l) = / 8 (0) = 0. 



(23) 



Integrating both sides of Ea. J22t with respect to y from to 
1 — x, we have 



/, (x) dy + (1 - xf 
'< Jo 



Mi 



y 



dy 



f q (y)dy + J^ (1-y^fl-— ],/„. 



which can be deformed as follows 



(1 - x) f q (x) + (1 - xf 



f q {t)dt 



n 



l-x j-l 

f q {t)dt + x q+1 / r q - 2 f q (t)dt. (24) 



Since the function f q (x) is continuous on the closed interval 
[0,1] due to condition (Fl), it is differentiable on the open 
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interval x £ (0, 1). By differentiating both sides of Ea. J24> 
and applying the relation 



f q (x) = f q (l - x) 
due to condition (F2), we have 

(l-aO/'(aO = (q+l)(l- x) q I f q (t)dt 



(25) 



+ {q + i)x« r«- 2 f q {t)dt~ 



(26) 



Since f' q (x) is also differentiable on (0, 1), by again differen- 
tiating both sides of Ea A26\ . we have 

(1 - X) f" (x) = -q(q + 1) (1 - x)"- 1 ( f q (t) dt 



(27) 



+q(q + l)xi- 1 J ro- 2 f q (i)dt 

X £ X H 

Multiplying both sides of Ea.J27> by x, we have 



x (1 - x) fl (x) = -q (q + 1) x (1 - x)^ 1 / /, (t) dt 



+q(q + l)x* / r*- 2 f q {t)dt 

J X 

-^- + (x-l)f q (x). 



(28) 



Also, multiplying both sides of Ea. J26> by q, we obtain 

q(l-x)f' q (x) = q(q + l) (1 - x) q f f q (t)dt 

Jo 

+q (q + 1) X q [ t~1- 2 f q (t) dt - ^M. (29) 

From Ea.(l28> and Eq.j29>. we have the following differential 
equation: 



xf q '(x) = (q-l)f q (x)-qX q (l-x) 



9-2 



(30) 



n > 3 by induction on n. Assuming that Eq. (l21> is true for 
any n € N, we obtain the following calculations: 



+ (x„ +x„ + i) 9 S' 9 



ra-1 

A 9 ^ Xi ~ ^1 ( Xn 2 '™+ 1 ) <il ^ n 9 (^n + ^ra+O 



"Ag (X„ + 3C„+l) 



n-1 

-A g a;? lrig a, - A 9 (i„ + x n+1 ) q \n q (x n + x n+ i) 



-\x q n In, ( ^ — - J - X q x q n+1 In, 



X n T" Xn+l 



X 7i T" 



n— i _^ 
-Ag ^ I? lllq X^ H~ \q (jX-n ~f~ Xn-\-l )ln„ 



l 



-AgX« +1 ( In, a: n+ i + a£ + j In, 



1 



X n -f- X n ^l 



n + 1 



A 9 51 ' T ? ln< 3 Xi 



This shows that Eg. J21I is also true for n+1. Thus, the proof 
of this theorem is completed. 



Remark V.3 If further conditions are imposed on Axiom IvTI 
such that S q (h, |) = 1, which is the normalization condition 
to characterize the structural a-entropy in [9], then we obtain 
A, = from Ea. (l32> . Thus, we straightforwardly obtain 
the structural a-entropy [9]: 



where A, = (q + 1) j} f q (t) dt. This differential equation has 
the following general solution with constants ci(q) and Oz(q), 
which depend only on parameter q: 

f q (x) = Cl (g) + c 2 (q)x« + Xq ^~* )q . (31) 

The initial condition Eq.( I23> implies Ci(q) = -^j. In addition, 
the condition Ea. J25> implies C2(q) = j^. Substituting ci(q) 
and 02(0) into Ea. (l31> . we have 



in a manner similar to the induction of the proof in Theorem 
IV2l This means that the present theorem includes the Havrda- 
Charvat's axiom as a special case. Note that the present 
axiom requires the symmetry condition, whereas the Havrda- 
Charvat's axiom requires the expandability condition. 

B. A relation to the generalized Shannon-Khinchin 's axiom 

Finally, the relationship between the generalized Shannon- 
Khinchin's axiom introduced in [8] and the generalized Fad- 
deev's axiom is studied. 



f q (x) = -X q {x q In, x + (1 - x) q lrig(l - a;)} , (32) Proposition V.4 Axiom ImTl implies Axiom 

after the calculations. Since there exists some to £ [0, 1] such Proof: The fact that conditions (Gl) and (G2) imply con- 
that f q (to) > 0, due to condition (Fl), and the range of S q dition (Fl) is trivial, thus we show conditions (Gl) and (G3) 
is R + , we have A g > for any q > 0. Therefore, Eq. (l21> is imply condition (F2). If all Xi, (i — 1, • • • , n) are positive 
proven for n = 2. Finally, Ea. (l21> is proven for the general rational numbers, then each xi can be represented by — , 



s 



X 



2 < li < m, li,m € Z). Applying condition (G3), since 
— = Y)l i — , we have 



1 

m 



il .. 




TO ' 


m y 


1 


1 


m 


m 



1 



V 



i=l 



The first term in the right-hand side of the above equation 
does not depend on the order of (h, ■ ■ ■ ,l n ). In addition, the 
method how to take the summation in the second term of the 
right-hand side of the above equation is arbitrary, so that the 
above equation is equivalent to 

( \ 

1111 



S 



V 



for the permutation {x^} from {xi} where x[ = -t, (2 < 
l'i _■ m i ^> TO S Z). That is, condition (F2) holds for any 
rational numbers x.j. If x.j is not a rational number, then the 
continuity of condition (Gl) after the approximation of Xi by 
a rational number is used, and then we have condition (F2). 
Finally, conditions (G3) and (G4) are applied to imply (F3). 
From conditions (G3), (G4) and (F2), we have 

1 r 



Sa 



2 2 



Sn 



S, 



1 1 



1 1 
;' 

1 



M2'2' '° 



S 



I,o,i,o 

2 2 



+ -5,(1,0) + -5,(1,0) 



2 2) 2i H " ' 2i 
We therefore obtain S q (l, 0) = 0, and thus it follows that 

S q {xi , • • • , x n —i, y, z) 

= Sq (xi, 0,^2,0, • • • ,x„_i,0, y, z) 



= S q (xi,-- ■ ,X n ) + ^ X i S q C 1 ' ) + X n S q 
i=l 

5} (xi , • • • , X n ) + X n Sq ( , 

\ Xn Xn 

which implies condition (F3). 

In addition, we have the following proposition: 



Proposition V.5 S q (X) = — X q Y17=i x t Xi satisfies Ax- 

iom inm 

Proof: Conditions (Gl) and (G4) are trivial. Condition 
(G2) is proven using the non-negativity of the Tsallis relative 
entropy: 

n 



D q (X\Y) = ~J2 x * ln i — 



for two random variables X and Y, where {xi} and {?/,}, 
(i = 1, ■■■,ri) are probability distributions of X and Y, 



respectively. See [19] for the mathematical properties of the 
Tsallis relative entropy. Its non-negativity can be easily proven 
by the convexity of the function — ln,(x). The non-negativity 
implies S q (X) < In, n by setting a random variable U = 
{«>'">} navm g a uniform distribution, as a special case 
of Y. The maximum value is attained when X = {—,••• — j. 
Note that A, does not depend on the method used to take the 
maximum of S q (X). Thus, condition (G2) is proven. Finally, 
condition (G3) is proven by direct calculation. 



Sq [Xl j ■ ' ' j Xn) + S ^ xfS, 

i=l 
n 

= — Xq ^ xf In, Xi + xlS, 



X%\ Xi 



i=l 
b n u q 



q \ ? ) 

Xi Xi 



X~L1 Xi mi 
Xi ' ' Xi 



q q i X n i X nrnn 
X n^q 1 ■— j • • ' 7 — 



i=l 

-XqX\ ( ( — '] lHg — 
I V Xl J Xl 



Xl 



Xlm\ \ i x lmi 

In, 



xi 



- / 1 
= -A, 2J m ? ^ - \ ( ^11 m 9 £ii + Iriq 1 



"t"^l mi lrig ^lmi ~t~ Xi mi In, 

-A, ( x* 2 In, a;„i + x nX In, — + • • 



l 



l 



= X q I Xilllg h * 

-A, / (xn H h a;i mi )ln 9 ^- H 



~t~ [Xni ~\~ ' ' ' ~\~ x nrUn ) In, ^ 

5g (^11 5 • • ' , X\ mi , • ' " , ^nl j " " " ; Xnm n ) ■ 



From Theorem IV.2I Proposition IV. 41 and Proposition IV.5I 
we have the following equivalent relation among Axiom IV. II 
Axiom Ull. II and Tsallis entropy: 

Theorem V.6 The following three statements are equivalent. 

(1) S q : A„ -> R+ satisfies Axiom IITlTI 

(2) Sq : A„ -> R+ satisfies Axiom IVTT1 

(3) For (xi, • • • , x„) G A„, there exists A, > such that 

n 

S q [x\ , ■ ■ ■ , x n ) = —Xq ^ ^ x| In, Xj. 

1=1 
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VI. Conclusions 

The uniqueness theorem for Tsallis entropy introduced by 
Suyari [8] was generalized to the case of Tsallis relative en- 
tropy and was simplified according to the manner of Faddeev 
[2], [4]. 

Tsallis relative entropy was characterized by the generalized 
Hobson's axiom. The present result includes the uniqueness 
theorem proven by Suyari as a special case, in the sense that 
the choice of a trivial distribution for B — {bj} of Tsallis 
relative entropy produces the essential form of Tsallis entropy. 
However, note that the present theorem requires the symmetry 
of condition (R2), whereas that of Suyari does not. 

Moreover, Tsallis entropy was characterized by the gen- 
eralized Faddeev's axiom, which is a simplification of the 
generalized Shannon-Khinchin's axiom introduced in [8], and 
the uniqueness theorem proved in [8] was slightly improved 
by introducing the generalized Faddeev's axiom. At the same 
time, the present result provides a generalization of the unique- 
ness theorem for Shannon entropy by means of the Faddeev's 
axiom. 
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